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® Remote control and pointing device. 



@ A control device method and apparatus has ap- 
plication for use in multi-media systems. The multi- 
media system contains a host computer having a 
video display, a control device and at least one 
target device. The target device is any remotely 
controlled equipment that the user wishes to in- 
tegrate into the multi-media system. The host com- 
puter contains a host system configuration which 
provides the user the ability to select an operating 
mode for the control device. The control device 
operates as an interactive user Interface to control a 
cursor on the host computer video display when the 



control device is placed In the cursor control mode. 
The user selects a remote control mode to remotely 
control the target devices using the control device. 
The host system configuration also includes learn 
and computer networking modes. In the learn mode, 
control data Information Is entered into the host 
system configuration for new target devices. In the 
computer networking mode, the control device op- 
erates as a network interface allowing other similarly 
equipped computers to communicate with the host 
computer. 
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BACKGROUND OF THE INVENTION 

1 FIELD OF THE INVENTION: 

The present invention relates to a control de- 
vice, and more particularly, to an apparatus and 
method for communicating between a host com- 
puter system and at least one target system with a 
remote control system. 

2 ART BACKGROUND : 

A mouse, or a cursor control device, is an 
instrument that is used to translate the motion of a 
user's hand into a series of electrical control sig- 
nals indicative of that hand movement. The mouse 
is coupled to a computer where the mouse gen- 
erated control signals are used to position a cursor 
on a computer display. An optical mouse is a 
cursor control device that uses optical sensing to 
generate the electrical control signals. An advan- 
tage of the optical mouse over a traditional me- 
chanical mouse is that the optical mouse does not 
employ any moving parts to generate the control 
signals. The optical mouse emanates an optical 
signal, usually in the infrared range, generated from 
a light emitting diode (LED). To generate the con- 
trol signals, the mouse is moved on a reflective 
pad having a large number of equally spaced verti- 
cal and horizontal lines. The vertical and horizontal 
lines have a different color than the background of 
the reflective pad. The optical mouse is placed on 
the reflective pad such that the optical light from 
the LED is reflected from the pad back into the 
optical mouse. 

The optical mouse further includes input optics 
and optical sensors mounted on the bottom of the 
mouse. The optical sensors generate an electrical 
signal proportional to the light incident upon the 
optical sensor. The LED and the optical sensors 
are arranged such that the light emanating from the 
LED is reflected off the pad and onto the optical 
sensors. To operate the mouse, a user moves the 
optical mouse across the reflective pad such that 
the optical light crosses over the horizontal and 
vertical lines. The amount of light reflected is de- 
creased when the light crosses over one of the 
horizontal or vertical lines on the pad. Consequent- 
ly, the light incident upon the photo diodes is 
decreased, and the mouse is able to detect the 
crossing of the line. The optical mouse generates 
four quadrature signals to indicate the movement to 
the computer based on the mouse crossing the 
horizontal and vertical lines. Typically, these four 
parallel quadrature signals are coupled to a stan- 
dard serial interface such as a universal asyn- 
chronous receiver transmitter (UART). The UART 
converts the quadrature signals into an encoded 



stream of serial data for transmission to the host 
computer system. 

Applications in optical transmissions are also 
found in consumer electronic devices. Consumer 

5 electronics devices, such as televisions and video 
cassette recorders (VCRs), often include remote 
control systems. Manual control systems, unlike 
remote control systems, require the user of the 
electronic device to physically go to the device to 

70 manipulate knobs and buttons. With the use of 
remote control, the user can control the device, 
from a limited distance, with a remote control unit 
thereby eliminating the need to physically touch 
the controls and adjustments on the device itself. 

75 The basic remote control system contains a trans- 
mitter on the remote control unit and a receiver on 
the device. The remote control unit contains but- 
tons where each button correlates to a device 
function. Each function is represented by an unique 

20 function code having a string of logical ones and 
zeros. When the user presses a button on the 
remote control unit for a desired function, the re- 
mote control unit retrieves the corresponding func- 
tion code and transmits it to the device. Various 

25 manufacturers of remote control systems use both 
different function codes and encoding techniques 
to modulate the function codes. The device re- 
ceives the modulated function code, demodulates 
the code back into a string of ones and zeros, and 

30 performs the desired function. 

I^ulti-media is the integration of several audio 
and video production units into a single controllable 
unit. Multi-media projects cover many communica- 
tion media types, including printed materials, audio 

35 programs, television shows, feature films and many 
others. The ability to integrate the functions of the 
resources utilized in the production of multi-media 
projects into a single shared system provides a 
level of performance and capability unknown in the 

40 prior art. A computer workstation may be the cen- 
ter of such a system by providing memory and 
digital processing capabilities. Referring to FIGURE 
1. a multi-media system is illustrated. A central 
control computer 20 is networked to: television 22; 

45 video cassette recorder (VCR) 24; video laser disc 
26; and compact audio disc 26. With such an 
integrated system, the user, at central control com- 
puter 20, can transfer information among the de- 
vices attached to the integrated network. 

50 A multi-media system, such as the one illus- 

trated in FIGURE 1, provides the user with a very 
powerful audio visual production center For exam- 
ple, the user may wish to manipulate a video 
image stored on laser disc 26. First, the video 

55 image must be transferred over the network from 
laser disc 26 and stored in memory in central 
control computer 20. To accomplish this task, the 
user would command, by a remote control unit. 
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laser disc 26 to play the video image over the 
network. Alter the video image is transferred to 
central control computer 20, the user may add 
special effects to the video image creating these 
effects directly on the computer. Alter generating 
the enhanced video image, the user may wish to 
store the video image on VCR 24. To accomplish 
this task, central control computer 20 sends the 
video image via some kind of interconnect (often in 
analog video), and the user remotely controls VCR 
24 to record the enhanced video image. In this 
example, in order to control both laser disc 26 and 
VCR 24, the user is required to use two remote 
control devices. Furthermore, the user is required 
to use a computer interactive device such as a 
mouse. 

SUMMARY OF THE INVENTION 
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Therefore, it is an objective of t he presen t 20 
i ny ention _to^ integl^t^T'comiioLdeyjc^^^ 
controLjdeyice^may operate _both ..as_.a_cu rsor co n; 
trol device and a ren riQte_ control deuc^^. It is a 
further objective of the present invention to provide 
a network interface among similarly equipped com- 
puter systems having a control device of the 
present invention. 

The present invention comprises of a host 
computer having a video display, a_con tEaLdeviee 
i ncludiIlg^-a-FefleGt^ve-&ad-aod- 3t least^o ne^Jatqet 
dj|yice, TJ^e tar get dQv l£i^ar.e,remote ly^c.oi itrolle d 
aud io.andLyicJiSIeq u 1 p menfe* The control device is 
coupled to the host computer through an interface. 
A host system configuration resides on the host 
computer allowing the user to control the operation 
of the control device by selecting a mode. The host 
system configuration includes a target device list 
which contains identifying names for the target 
devices currently supported by the host computer. 
For each target device on the target device list, 
there is a corresponding function list The function 
list contains control data for each function of the 
target device supported by the host system con- 
figuration. If no mode is selected, the control de- 
vice operates in a cursor control mode. From the 
host system configuration, the user may select a 
remote control, learn or computer networking 
modes. 

The control device has an encoder coupled to 
a transmitter, and a decoder coupled to input op- 
tics. When the control device is operating in the 
cursor control mode, the user moves the control 
device across the reflective pad to control the 
movement of a cursor on the host computer video 
display. The transmitter of the control device ema- 
nates a signal, preferably in the optical range, 
which is reflected off the reflective pad and into the 
input optics. The input optics amplifies the re- 



flected signal for input to the decoder. The decoder 
generates position signals based on the intensity of 
the reflected signal. When .the cp^ntroMevice is,in_ 
thej:emotej:ontroi jnode, the host computer sends 
target dev ice control data, over t he^-interface^to the- 
-fiocpjdex. The^eRcocler^generate,s_an analog signal 
^m the_contcoLd ata,„and mod uiates^the-transmit^- 
JtQ'L. with^, the anaiog _signal. Jo control. Jhe Jarget 
^device, .thejjser Jhgjdsjhe.control-device^ch that , 
the^bottom-of- the-device= is pointed at. the target 
device. -Up,^i^depcessing ..a,,switch. on the^control- 
device, jtb_Q..,comroUdevice^^ the. jT\odulated 

s i g natto.th^eJtarggt.de vice 

The learn mode of the present invention allows 
the host system configuration to "learn" control 
data for functions of a target device. In the learn 
mode, new target devices are added to the target 
device list. In addition, control data is added to the 
function list for the corresponding target device. 
The control device also operates as a computer 
network interface when the user selects the com- 
puter networking mode from the host system con- 
figuration. In the computer networking mode, the 
host computer sends information, modulated by the 
encoder in the control device, to target computers 
equipped with the control device of the present 
invention. The target computer sends modulated 
T^^^^'^essages to the host computer which are decoded 
in the control device and subsequently transferred 
to the host computer. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIGURE 1 illustrates a multi-media system in- 
35 eluding a central control computer. 

FIGURE 2 is an illustration of the control device 
of the present invention. 

FIGURE 3 is an illustration of the host system 
configuration of the present invention. 
40 FIGURE 4 is a flow control diagram of the 

remote control mode of the present invention. 

FIGURE 5 is a flow control diagram of the learn 
mode of the present invention. 

FIGURE 6 is a flow control diagram of the 
45 computer network mode of the present invention. 

FIGURE 7 is a block diagram illustrating the 
control device decoder of the present invention. 

FIGURE 8 is a block diagram illustrating the 
control device encoder of the present invention. 

50 

DETAILED DESCRIPTION OF THE INVENTION 

A method and apparatus for a control device is 
disclosed. In the following description, for purposes 
55 of explanation, specific nomenclature is set forth to 
provide a thorough understanding of the present 
invention. However, it will be apparent to one 
skilled in the art that these specific details are not 
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required to practice the present invention. In other 
instances, well known circuits and devices are 
shown in block diagram fornr) to avoid obscuring 
the present invention unnecessarily. 

Referring to FIGURE 2. a high level block dia- 
gram of the present invention is illustrated. Host 
computer 34 is coupled to control device 30 
through interface 31. The host computer 34 may 
be a computer system such as a SPARC ^" work- 
station, manufactured by Sun Microsystems, Inc. of 
Mountain View. California. Interface 31 is bi-direc- 
tional such that host computer 34 transmits in- 
formation to control device 30, and control device 
30 transmits information to host computer 34. Qoo- 
troj devi ce 30 inputs extern al signals through input 
9ptips!^3.8u. and the external^"sigrTSl^^re~interpreted 
by decoder 36. Information generated by decoder 
36 is transferred to interface control 33, and then 
transmitted through interface 31 to host computer 
34. Information transmitted from host computer 34 
over interface 31 is received by control device 30 
at interface control 33. The information is then 
transferred to encoder 42 and subsequently trans- 
mitted by transmitter 44. 

Host computer 34 provides a user the ability to 
select among a plurality of operating modes for 
control device 30. These operating modes include 
a cursor control mode, a remote contLoJ_rnode. a 
learn mode and a computer networking mode. If no 
mode is selected by the user, control device 30 
operates in the cursor control mode. In the cursor 
control mode, control device 30 will be placed on 
top of reflective pad 46. When the user selects 
either the remote control or the learn mode, control 
device 30 will operate as a remote control device. 
WS§njjsed^§^_Lemote*comi:oi-^e^ 
ot co ntrol device_30 Js^difeeted_at aJajaet device. 
sugfTasTarget devi ce 48 or 50. Also, when the user 
selects the computer networking mode from host 
computer 34, control device 30 operates as a net- 
work interface. In the computer networking mode, 
the bottom of control device 30 is directed at a 
target computer such as target computer 51. 

In the^cujgor ^ntrol mode, co ntrol-de yice 30 j s 
.a^cupsor..xxto|r ol device. A s.a.gursor-control-devjcQ; 
ppsition^data^is.geriecated_byjdacQder^3 ^ on , 
the^movemeat^oL^c^^^ 

.P§<iJ*6. Position data are transferred from decoder 
36 to interface control 33 and then transmitted over 
interface 31 to host computer 34. In the cursor 
control mode, datum is not transferred from the 
host computer 34 to control device 30. Because of 
this, encoder 42 of control device 30 is bypassed 
such that transmitter 44 will provide a continuous 
signal output to reflective pad 46. The continuous 
output signal is reflected by reflective pad 46 back 
toward control device 30. The reflected signal is 
collimated and amplified by input optics 38 and 



projected upon photosensitive cells in decoder 36. 
Because the system is in cursor control device 
mode, decoder 36 is selected to decode the illu- 
mination of the photosensitive cells to generate 

5 position data. The position data are then trans- 
ferred to the host computer 34 to control a cursor 
on video output display 32. 

To select a particular mode for control device 
30, the user, though a man to machine interface on 

10 host computer 34, activates a mode selection 
menu. Because a mode has not been selected, 
control device 30 will automatically operate in the 
cursor control mode. The mode selection menu 
may be displayed and accessed by the user by 

75 any type of man to machine interface. Preferably, a 
graphical user interface is used, and control device 
30 modes are viewed by user as icons. Regardless 
of how the man to machine interface is accom- 
plished, host computer 34 will display the mode 

20 selection to the user on video output display 32. 
Th^ jjser mav ,use--a4<eyboar4...orLControL devlce 3 .Q_ 
a.g^a-.cuj:sojL- £Ontrol_device. to .-SSiect^the ^desired 
operating mode for cofUroL devLce 30. Once a 
mode has-been selecteQ, another menu will appear 

25 prompting the user to make more selections for the 
desired function as will be more fully explained 
below. 

Referring to FIGURE 3, the host system con- 
figuration of the present invention is illustrated. In 

30 order to support the remote control, learn, and 
computer networking modes, host computer 34 
must contain specific information about target de- 
vices and target computers. User interface 54 is 
the man to machine interface between the host 

35 system configuration and the user. Any user inter- 
face may be employed to implement the structure 
of the host system configuration. Mode selection 
module 56 illustrates the first level of the host 
system configuration. As described above, mode 

40 selection module 56 provides a menu from which 
the learn, remote control, and computer networking 
modes are selected. To support the selection of 
remote control mode, remote control mode module 
62 accesses target device list 64. Target device list 

45 64 compnses a list of all the target devices cur- 
rently supported by the host system configuration. 
For each target device in target device list 64, 
there IS a corresponding function list illustrated as 
function list 66. As illustrated in FIGURE 3, a target 

50 device may only access the corresponding target 
device function list that corresponds to that target 
device. Function list 66 stores control data for each 
of the target device functions listed in function list 
66. For example, for target device there is a 

55 target device #1 function list which stores the con- 
trol data for all of the currently supported target 
device #1 functions. 
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Stili referring to FIGURE 3, learn mode module 
60 is selected from mode selection module 56. 
Learn mode module 60 provides the user the abil- 
ity to edit target device list 64 and function list 66. 
If the user wishes to add another target device to 
the host system configuration, then target device 
edit module 68 allows the user to enter an identify- 
ing name for the new target device. Once target 
device list 64 has been edited to contain the new 
target device, function list edit module 70 allows 
the user to add target device functions to function 
list 66. In the learn mode, control data will be 
entered into function list 66 under the correspond- 
ing function. When control device 30 is in the 
computer networking mode, computer mode mod- 
ule 59 is selected by mode selection 56. Computer 
mode module 59 contains network computer list 
72, network computer address list 74 and network 
computer edit 76. The user has the ability to select 
a target computer from network computer list 72. If 
the desired target computer is not listed on network 
computer list 72. then network computer edit mod- 
ule 76 is activated which allows the user to add an 
identifying name for the new target computer. Simi- 
larly, network computer addresses are added by 
the user for the newly added target computer 
through computer network edit 76. 

Referring to FIGURE 4, a flow diagram of the 
remote control mode is illustrated. lD-^th.e,-j:emote 
^^CilrQ' mode^ont rol devic e_30_j3pecata3^ as a 
ceipote--ContrQl^evlee*whictx,c ontrols j^irtu ally a n y- 
^roductaitilizing_ a^emQte_j ::Qntror^yste the 
user has selected the remote control mode through 
mode selection module 56, host computer 34 dis- 
plays a list of the available target systems as 
shown in block 78. In block 80, the user is promp- 
ted to select a target device. For example, the user 
may select a first VCR which is identified on the 
target device list as "VCR #1". Upon selection of 
the desired target device, the host computer 34 
displays a function list for the particular target 
device selected as illustrated in block 82. Next, 
host computer 34 will prompt the user to select a 
desired function from the function list as shown in 
block 84. For example, if "VCR #1" is chosen as 
the target device, the function list will display all 
functions for "VCR #1" residing in the function list. 
The function list for "VCR #1" may contain "Pow- 
er", "Play", "Rewind", "Fast Forward" and 
"Record". 

Upon completion of selecting the desired func- 
tion by the user, hp^t cQmpute>^^a4.-r etrieves t he 
^gDlcQjLdat a stnrftri J n -tl ^ f untliw -Ois Lfor the cor - 

rftc;pnnHinr) gQlQCtftH tarqftf device aS^- ShqwO—iCL 

jl ock 86. In blo ckJ7y*test-€QCQ p_uier 34 transmits a 
jnessaqe tnrou5 LiPtertace*31»wlucb-ejriablesswitch 
r.ontroi.AO^Thei^.-iQ^blQ ck^. .the; user , pointsjlie 
i30ttom_ end_ of contro Ldev4ceu30-at^t fa,e_ target de-^ 



\dc ^_ In block 90. _t he-atser_deDiBSses-a.„switGh> 
iQc ated on contr^ Ldeviee^O-which-Gonverts-CQotcol 
device30jiwi_^.cupso 

Q0Otr33^i£&-''"he depressing of the switch ini- 

5 tiates the transmission of the control data from host 
computer 34 to control device 30 as illustrated in 
block 92. In block 94, control device 30 recon- 
structs the control data in the original analog for- 
mat, and transmits the control data to the target 

10 device. Alter the control data has been transmitted, 
the host computer 34 places control device 30 in 
the cursor control mode as shown in block 95. The 
user now has full use of control device 30 as an 
interactive cursor control device. In block 96, host 

75 computer 34 queries the user about whether to 
remain in the remote control mode. If the user 
wishes to remain in the remote control mode, host 
computer 34 will prompt the user as to whether a 
new device is desired, as illustrated in block 97. If 

20 the user does wish to execute another function for 
the target device selected, then host computer 34 
will display the target device list. Alternatively, host 
computer 34 will display the target system as 
shown in block 78, and the user may then select a 

25 new target device. 

Referring now to FIGURE 5, a flow diagram of 
the learn mode of the present invention is illus- 
trated. Learn mode allows the user to add both new 
target device systems functions to the host system 

30 configuration. In this way, any target device using a 
remote control unit in the same optical band as 
control device 30 can be "learned" by host com- 
puter 34. Even if the format for the control data of 
the desired target system's remote control is com- 

35 pletely different than any other target device, host 
computer 34 can still learn the sequence for the 
control data. To enter learn mode, the user selects 
the mode selection menu. Within the mode selec- 
tion menu, the user selects the learn mode option 

40 as indicated in block 98. The user determines 
whether a desired target device exists in the host 
system configuration by viewing the target device 
list. If the desired target device is not on the target 
device list, the user is prompted to enter an iden- 

45 tifying name of the new target device as shown in 
block 104. The name is a mere identifier, and the 
target device name can be any name the user 
wishes to associate with the new target device. For 
example, if the user has a second VCR in which 

50 the user desired to integrate into a multi-media 
system, the second VCR could be named "VCR 
#2". After the user has entered the name of the net 
target device, host computer 34 adds the new 
target device to the target device list as well as to 

55 the corresponding function list as illustrated in 
block 106. Next, the user adds functions associated 
with the new target device such that the control 
data of the associated functions will be learned by 



5 



9 



EP 0 596 594 A1 



10 



host computer 34. 

The procedure for learning functions for a new 
target device is illustrated at block 108 in the flow 
diagram of FIGURE 5. First, the user is prompted 
to enter an identifying name of the function. Host 
computer 34 adds the function name to the func- 
tion list under the newly created designation for the 
new target device. At this point, the host system 
configuration is ready to accept control data. In 
block 109, host computer 34, through interface 31. 
enables switch control 40. In block 110, the user 
points the bottom of control device 30 at the re- 
mote control unit for the new target device. In block 
112, the user depresses a switch on the control 
device 30 which places the control device 30 into 
remote control mode. Next, the user depresses the 
desired function key on the target device remote 
control unit as illustrated in block 116. Upon de- 
pressing the function key on the target device 
remote control unit, the control data .for the function 
is transmitted to control device 30. In control de- 
vice 30, the control data is received and demodu- 
lated, and then transferred to the host computer 34. 
In block 118, host computer 34 determines whether 
the transmission is the first or second transmission 
of the function. In it is the first transmission, then 
the data is stored in a comparison buffer in host 
computer system 34. 

Upon receipt of the first transmission of the 
control data for the function by host computer 34, 
host computer 34 prompts the user to repeat the 
transmission of the control data from the target 
device remote control unit to the control device 30 
as illustrated in block 110. The user executes the 
procedure of blocks 110, 112 and 116, whereby a 
second transmission of control data is performed. 
In block 119. host computer 34 compares the sec- 
ond transmission of the control data to the first 
transmission of the control data to ascertain any 
differences. If the control data sequences are the 
same, the control data is stored In the host system 
configuration. If the comparison yields that the se- 
quences are not the same, then both transmissions 
are repeated starting in block 110. The purpose of 
transmitting the control data twice is to ensure the 
proper control data is associated with the desired 
function. The two transmissions reduce the pos- 
sibility that an error has occurred, and provide 
control data integrity for the function. In block 120, 
host computer 34 places control device 30 into 
cursor control mode. If the user wishes to remain in 
the learn mode, then the user is prompted by host 
computer 34 to select a target device system. 

Referring to FIGURE 6, a flow diagram of the 
computer networking mode of the present invention 
is illustrated. Alter the user has selected the com- 
puter networking mode through mode selection 
module 56. host computer 34 displays the network 



computer list 72 as shown in block 122. Network 
computer list 72 contains all the target computers 
currently supported in the host system configura- 
tion. Then, the user ascertains whether the target 

5 computer resides on the network computer list 72. 
If it does not. then the user executes block 126 by 
entering an identifying name for the new computer 
to be added to the network computer list 72. In 
addition to entering a name for the new target 

70 computer, the user also enters the target computer 
address for the network computer address list. Ad- 
ditional hardware could be added to host computer 
34 and the target computers to perform higher 
level networking functions such as address rec- 

15 ognition. However, it is currently recognized by 
practitioners in the art of computer networking, that 
tradeoffs between implementing certain features di- 
rectly in electronic circuits or implementing these 
features in software does not materially change the 

20 fundamental nature of the implementation. In order 
to improve the communication bandwidth and to 
reduce the likelihood of accidentally issuing a com- 
mand to a target device, instead of a target com- 
puter, a different encoding method may be em- 

25 ployed. For example, a different frequency and 
duration for encoding a logical one state can be 
employed. In this way. other target computers can 
ascertain whether another computer is currently 
transmitting. 

30 When a user desires to transmit a message on 

the computer network, the user must first select a 
target computer from the network computer list as 
illustrated in block 130 of FIGURE 6, After the user 
selects a message to transmit to the target com- 
as puter, host computer 34 obtains the address for the 
target computer from the network computer ad- 
dress list as shown in blocks 132 and 134, respec- 
tively. In block 136, host computer 34 merges the 
address information for the selected target com- 
40 puter with the message selected. Then, in block 
137, host computer 34 enables switch control 40. 
To transmit the message to the target computer, 
the user points the bottom of control device 30 at 
the target computer and depresses switch 41 on 
45 the control device 30 as shown in blocks 138 and 
140- Upon depression of switch 41, host computer 
34 transfers the message from host computer 34 to 
control device 30 as illustrated in block 142. In 
block 144, control device 30 reconstructs the con- 
so trol data into an analog modulated wave form for 
transmission to the target computer. Upon trans- 
mission of the message, host computer 34 places 
control device 30 into the cursor control mode as 
illustrated in block 145. 
55 Referring now to FIGURE 7, a block diagram of 

decoder 36, input optics 38, interface control 33 
and switch control 40 are illustrated. Input optics 38 
receives external signals from reflective pad 46, a 
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target computer or a remote control unit. Prefer- 
ably, input optics 38 contains an aperture at the 
bottom of control device 30 which allows the exter- 
nal signal, such as an infrared signal, to pass into 
input optics 38. Input optics 38 also contains an 
optical guide and lens. The external signal passes 
through the aperture and is amplified and focused 
by the lens. The external signal is then collimated 
through the optical guide, and focused upon sensor 
array 148. The focal distance between the lens and 
sensor array 148 is a predetermined value. Sensor 
array 148 may be a single photosensitive celt or an 
array of photosensitive cells. Photosensitive cells 
generate an electrical signal proportionate to light 
intensity incident upon the cell. The photosensitive 
cells may be photo diodes or any other form of 
photo voltaic cells. For example, sensor array 148 
could be arranged in a 2x2 array of photosensitive 
cells, or it may be arranged in a linear array 
comprised of 4 photosensitive cells. 

The output of the sensor array 148 is con- 
nected in parallel to both the imager 152 and an A 
to D converter 160. The signal on control line 151 
is generated by switch control 40. Switch control 
40 contains switch 41, AND gate 165 and D type 
flip-flop 163. Switch 41 is a momentary micro 
switch which is accessible to the user at the top of 
control device 30. The output of switch 41 is coup- 
led to the D and dock inputs of fiip-flop 163, 
preferably through a debouncing circuit (not 
shown). Flip-flop 163 is reset by mode select 161 
such that a falling edge of a high to low signal 
transition on mode select line 161 initials flip-flop 
163 to a low logic state. AND gate 165 has two 
inputs; a first input coupled to the Q output of flip- 
flop 163 and a second input coupled to mode 
select 161. 

Initially, the Q output of flip-flop 163 retains a 
low logic state. After the user has selected, for 
example, the learn mode in the host system con- 
figuration, host computer 34 sets, through interface 
control 33. mode select line 161 to a high logic 
state. At this time, the user depresses switch 41 
causing the Q output of flip-flop 163 to toggle to a 
high logic state. With both mode select 161 and Q 
output of flip-flop 163 at a high logic state, the 
output of AND gate 165, which drives control line 
151. is set to a high logic state. A high logic state 
on control line 151 will cause MUX'S 172 and 149 
to operate in the learn, computer networking, or 
remote control modes and selects whether the A to 
D 160 or the imager 152 is active. To convert 
control device 30 back to the cursor control mode, 
host computer 34 places mode select 161 in a low 
logic state, and the falling edge of a high to low 
signal transition of mode select line 161 resets flip- 
flop 163 to a low logic state. A low logic state on 
mode select 161 and an initialized flip-flop 163 pull 



control line 151 to a low logic state. A low logic 
state on control line 151 selects the cursor control 
mode at MUX'S 149 and 172. 

When control device 30 is in the cursor control 

5 mode, decoder 36 generates position data. As de- 
scribed above, control line 151 actuates the imager 
152 such that electrical charges generated by sen- 
sor array 148 are processed by bit map imager 
152. Bit map imager 152 generates a bit map 

10 based on the illumination of photosensitive cells in 
sensor array 148. Preferably, bit map imager 152 
consists of cell inhibition logic and timing logic. 
The cell inhibition logic is coupled to sensor array 
148 such that the first cell to obtain a predeter- 

75 mined threshold charge will inhibit other neighbor- 
ing cells. The inhibition of neighboring cells results 
in the generation of bit map images. For example, 
sensor array 148 may contain a 2x1 photosensitive 
cell array consisting of two linear cells for horizon- 

20 tal movement detection. Applying a cell inhibition 
technique to the array, one cell will be inhibited 
when the other cell is illuminated to the predeter- 
mined threshold value. In this example, there is a 
possibility of three bit map images; a first bit map 

25 image consists of illumination of the first cell only; 
a second bit map image consists of illumination of 
the second cell only; and a third bit map image 
consists of no cells illuminated. As control device 
30 is moved across the horizontal lines of the pad, 

30 the photosensitive cell receiving light reflected from 
the background will illuminate the photosensitive 
cell to the threshold value faster than the other 
photosensitive cell receiving light reflected from a 
horizontal line. A linear 2x1 vertical array senses 

35 the movement in a vertical direction in a similar 
manner. Based on this technique, other more com- 
plex arrays, such as a 4x4 photosensitive cell ar- 
ray, could be implemented. Larger arrays provide 
greater position resolution for cursor control on a 

40 video output display. 

Once a first bit map image is generated, bit 
map imager 152 generates signals to dear sensor 
array 148. Because control device 30 is operating 
in the cursor control mode, control line 151 selects 

45 bit map imager 152 in MUX 149 to control the 
initialization input to sensor array 148. Bit map 
imager 152 is self timed because a bit map image 
will be generated when one or more of the pho- 
tosensitive cells are illuminated to the threshold 

50 value. The first bit map image is transferred to 
coordinate generator 154 while a second bit map 
image is being generated in sensor array 148. 
Preferably, coordinate generator 154 contains com- 
parison means, a look-up table and a quadrature 

55 signal generator. The first bit map image is stored 
in a comparison buffer. The second bit map image 
is generated from bit map imager 152, and then 
transferred to a second comparison buffer in co- 
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ordinate generation 154. Upon receipt of the sec- 
ond bit map innage. coordinate generation 154 
compares the first bit map image with the second 
bit map image. The comparison yields a look-up 
code: the look-up code indicating differences be- 
tween the first bit map image and the second bit 
map image. 

The look-up code generated from the compara- 
tor means is used to index the look-up table. The 
look-up table generates a control code indicating 
the direction and distance of the movement of the 
control device. For example, in the 2x1 horizontal 
cell array described above, if the first bit map 
image contained a {1, 0} illumination, and the 
second bit map image contained a {0, 1} illumina- 
tion, then the bit map image would generate a 
control code indicative of a horizontal move to the 
right. The control code from the look-up table must 
be converted into the well known quadrature signal 
format for cursor control devices. The control code 
is input to the quadrature signal generator, and the 
quadrature signal generator generates the four 
quadrature signalis. The quadrature signals are in- 
put to transceiver 146, and then transferred to host 
computer 34. 

A block diagram of demodulator 158 is illus- 
trated in FIGURE 7. As discussed above, the output 
of sensor array 148 is an analog signal proportional 
to the light intensity incident upon the photosen- 
sitive cells of sensor array 148. In the learn mode, 
the analog signal is the modulated control data 
from the remote control unit. In the computer net- 
working mode, the analog signal is the modulated 
message from a target computer. The analog sig- 
nal is input to demodulator 158 in analog to digital 
(A/D) converter 160. Methods for A/D conversion 
are well known in the art. and A/D converter 160 
may employ a flash method, a half flash method, or 
any other method of analog to digital conversion. 
The initialization of sensor array 148 is controlled 
by the output signal of MUX 149. In the computer 
networking or learn modes, control line 151 selects 
dock 156. In operation, the photosensitive cells of 
sensor array 148 are illuminated during a first 
phase of the clock 156 cycle. During the second 
phase of the dock cycle, A/D converter 160 reads 
illuminated cell values, and clock 156 clears the 
photosensitive cells in sensor array 148. 

In the preferred embodiment, the sampling fre- 
quency of dock 156 is 500 Khz, Typically, a remote 
control unit modulates each bit of control data in 
600 microsecond pulses. A logical one bit of con- 
trol data is represented by a 50 Khz tone modu- 
lated on the 600 microsecond pulse, and a logical 
zero bit is represented by no tone modulated on 
the 600 microsecond pulse. For this control data 
modulation scheme, A/D converter 160 samples 
the analog input signal five times the highest input 



frequency. Therefore, at a sampling frequency five 
times the input frequency of the analog signal, 
demodulator 158 generates a digital signal which 
accurately represents the input analog signal. Us- 

s ing A/D conversion, the operation of control device 
30 is not dependent upon the format of the input 
control data signal. 

The digital output of A/D converter 160 is input 
to filter 162. Preferably, filter 162 is an anti-alaising 

70 filter that filters out the sampling harmonics gen- 
erated by the sampling of A/D converter 160. The 
bandwidth characteristics of filter 162 are deter- 
mined by the sampling frequency of dock 156, and 
if the input analog signal is sufficiently over sam- 

75 pled, a wide bandwidth for filter 162 does not 
degrade system performance. The output of de- 
modulator 158 is input to channel B of transceiver 
146. In the preferred embodiment, transceiver 146 
is a universal asynchronous receiver transmitter 

20 (UART) which is a standard interface between a 
cursor control device and a host computer. Control 
line 151 is connected to channel select on tran- 
sceiver 146. The selecting of channel A or channel 
B of transceiver 146 is determined by the logic 

25 state of control line 151. A logic low state on 
control line 151, designating control device 30 is in 
the cursor control mode, selects channel A. Alter- 
natively, a logic high state on control line 151 
selects channel 8 when control device 30 is in the 

30 learn, remote control or the computer networking 
modes. 

Referring to FIGURE 8, encoder 42, transceiver 
164 and transmitter 44 are illustrated. Control data 
transferred from host computer 34 is received by 

35 control device 30 at transceiver 164. Control data 
are input to encoder 42. and encoder 42 generates 
a modulated signal. The output of encoder 42 is a 
first input to MUX 172, and a second input to MUX 
172 is coupled to a power source for control device 

40 30. The output of MUX 172 is coupled to transmit- 
ter 44. When control device 30 is in the cursor 
control mode, control line 151 selects the power 
source input to transmitter 44. In the preferred 
embodiment, transmitter 44 is an infrared light 

45 emitting diode (LED). Therefore, in the cursor con- 
trol mode, the LED is supplied a constant power 
source, and the output of transmitter 44 will not be 
modulated. Alternatively, when control line 151 se- 
lects the encoder 42 output, the modulated signal 

50 generated by encoder 42 is transmitted by the 
LED. 

The input to encoder 42 is the control data, in 
digitized form, transmitted from host computer 34. 
Transceiver 164 will receive control data at a serial 
55 bit rate corresponding to the data transferred from 
host computer 34 to transceiver 164. Encoder 42 
contains buffer 166. digital to analog converter 
(DAC) 168 and filter 170. Control data is transferred 
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om transceiver 164 to buffer 166 in encoder 42. 
Buffer 166 stores a plurality of control data entries 
allowing encoder 42 to receive the control data at a 
data rate driven by transceiver 164. Buffer 166 is 
coupled to DAC 168 by data lines 165 and enable 
line 167. Buffer 166 generates a signal over enable 
line 167 signifying control data has been received 
by buffer 166. Once DAC 168 is enabled by enable 
line 167, DAC 168 begins to clock in control data 
stored in buffer 166 at the clocking rate of clock 
156. Control data is converted in DAC 168 from 
digital data to an analog signal. In the rennote 
control nnode, the analog signal is a reconstruction 
of the analog signal received by control device 30 
in the learn mode. In the computer networking 
mode, the analog signal is a modulated message 
transferred from host computer 34. The analog 
output of DAC 168 is input to filter 170. Filter 170 
reduces or eliminates frequencies generated in the 
digital to analog process of DAC 168. Filter 170 
has a sufficient bandwidth to accommodate the 
reconstruction of a wide range of control data. 

While the present invention has been de- 
scribed in terms of a presently preferred embodi- 
ment, those skilled in the art will recognize that the 
invention is not limited to the embodiment de- 
scribed. The method and apparatus of the present 
invention can be practiced with modification and 
alteration within the spirit and scope of the appen- 
ded claims. The description is thus to be regarded 
as illustrative instead of restrictive on the present 
invention. 

Claims 

1. In a system having a host computer and at 
least one target device wherein said host com- 
puter comprises of a central processing unit 
(CPU), memory for storing a plurality of control 
functions, a video output display, a control 
device for generating position data relative to 
movement of said control device for display on 
said video output display and for remotely 
controlling said target device currently sup- 
ported by said host computer, said control 
device comprising: 

host system configuration means for gen- 
erating a plurality of operating modes on said 
host computer to be selected by said control 
device and for generating control data to op- 
erate said target device, said control data cor- 
responding to one of said plurality of operating 
modes selected; 

cursor control means coupled to said host 
system configuration means for generating po- 
sition data to said video output display, said 
cursor' control means being capable of select- 
ing one of said plurality of operating modes 



from said host system configuration means by 
controlling said video output display through 
said position data; 

receiver means coupled to said cursor 
5 control means for receiving said control data 

from said host system configuration means; 

encoder means coupled to said receiver 
means for modulating said control data cor- 
responding to said one selected mode to gen- 
re erate modulated control data; 

transmitter means coupled to said encoder 
means for transmitting said modulated control 
data representative of said one selected mode 
to said target device. 

75 

2. A control device according to claim 1, wherein 
said cursor control means comprises: 

position means for generating displace- 
ment signals representing the movement of 
20 said cursor control means relative to said posi- 

tion means, said cursor control means emitting 
a continuous signal during the movement; and 
decoder means coupled to said cursor 
control means for generating said position data 
25 to said video output display responsive to said 

displacement signals. 

3. A control device according to claim 1, wherein 
said host system configuration generates said 

30 plurality of operating modes to be selected 

through a graphical user interface menu dis- 
played on said video output display, one of 
said plurality of operating modes being se- 
lected by said position data. 

35 

4. A control device according to claim 3, wherein 
said host system configuration means com- 
prises: 

remote control means for retrieving remote 
40 control functions stored in said memory of said 

host computer system when selected as one 
of said plurality of operating modes and trans- 
ferring said remote control functions to said 
target device through said encoder means and 
45 said transmitter means; 

learn control means for updating said 
memory of said host computer system with the 
control functions associated with a second tar- 
get device not previously coupled to said sys- 
50 tern when selected as one of said plurality of 

operating modes, said control functions asso- 
ciated with said second target device being 
subsequently invoked by said remote control 
means; 

55 cursor mode means for activating said cur- 

sor control means when selected as one of 
said plurality of operating modes. 
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A control device according to claim 4, said 
host system configuration means further com- 
prising: 

network control means for retrieving net- 
work control functions store in said memory of 5 
said host computer system when selected as 
one of said plurality of operating modes and 
when said system is coupled to a third target 
computer through a network, said network con- 
trol means transferring said network control io 
functions to said target device through said 
encoder means and said transmitter means. 

A control device according to claim 5, wherein 
transmitter means transmits said modulated is 
control data in infrared signal. 

A control device according to claim 2, wherein 
said position means generates said displace- 
ment signals by reflecting said continuous sig- 20 
nal from said cursor control means and said 
decoder means comprises an optical input for 
receiving the reflected continuous signal. 

In a system having a host computer and at 25 
least one target device wherein said host com- 
puter comprises of a central processing unit 
(CPU), memory for storing a plurality of control 
functions, a video output display, a method of 
generating position data relative to movement 30 
of said control device for display on said video 
output display and of remotely controlling said 
target device currently supported by said host 
computer, said method comprising the steps 
of: 35 

generating a plurality of operating modes 
on said host computer on host system configu- 
ration means to be selected by said control 
device and for generating control data to op- 
erate said target device, said control data cor- 40 
responding to one of said plurality of operating 
modes selected; 

generating position data to said video out- 
put display through cursor control means 
coupled to said host system configuration 45 
means, said cursor control means being ca- 
pable of selecting one of said plurality of op- 
erating modes from said host system configu- 
ration means by controlling said video output 
display through said position data: so 

receiving said control data from said host 
system configuration means by receiver 
means coupled to said cursor control means; 

modulating said control data correspond- 
ing to said one selected mode to generate 55 
modulated control data through encoder 
means coupled to said receiver means; 

transmitting said modulated control data 



representative of said one selected mode to 
said target device on transmitter means coup- 
led to said encoder means. 

9. A method according to claim 8, wherein the 
step of generating position data to said video 
output display through cursor control means 
comprises: 

generating displacement signals represent- 
ing the movement of said cursor control means 
relative to said position means on position 
means, said cursor control means emitting a 
continuous signal during the movement; and 

generating said position data to said video 
output display responsive to said displacement 
signals on decoder means coupled to said 
cursor control means. 

10. A method according to claim 8, wherein the 
step of generating a plurality of operating 
modes on said host computer comprises gen- 
erating through a graphical user interface 
menu displayed on said video output display, 
one of said plurality of operating modes being 
selected by said position data. 

11. A method according to claim 10. wherein the 
step of generating a plurality of operating 
modes on said host computer on host system 
configuration means comprises: 

retrieving remote control functions stored 
in said memory of said host computer system 
through remote control means when selected 
as one of said plurality of operating modes and 
transferring said remote control, functions to 
said target device through said encoder means 
and said transmitter means; 

updating said memory of said host com- 
puter system on learn control means with the 
control functions associated with a second tar- 
get device not previously coupled to said sys- 
tem when selected as one of said plurality of 
operating modes, said control functions asso- 
ciated with said second target device being 
subsequently invoked by said remote control 
means; 

activating said cursor control means 
through cursor mode means when selected as 
one of said plurality of operating modes. 

12. A method according to claim 11, further com- 
prising the step of: 

retrieving network control functions store in 
said memory of said host computer system 
through network control means when selected 
as one of said plurality of operating modes and 
when said system is coupled to a third target 
computer through a network, said network con- 
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trol means transferring said network control 
functions to said target device through said 
encoder means and said transmitter means. 

13. A method according to claim 12, wherein said 
transmitter means transmits said modulated 
control data in infrared signal. 



16. A control device according to claim 15, 
wherein said host system configuration means 
further comprises update means for adding an 
additional target device to said plurality of tar- 

5 get devices already supported by said host 

computer, said update means storing corre- 
sponding control data in said memory. 

17. A control device according to claim 16, 
wherein said control means comprises an op- 
tical cursor control and reflective pad for con- 
trolling cursor movement on said GUI-based 
video output display. 



14. A method according to claim 9, wherein said 
position means generates said displacement io 
signals by reflecting said continuous signal 
from said cursor control means and said de- 
coder means comprises an optical input for 
receiving the reflected continuous signal. 

15 

15. In a multimedia system having a host com- 
puter and a plurality of target devices sup- 
ported by said host computer, wherein said 
host computer comprises of a central process- 
ing unit (CPU), memory, a graphical user inter- 20 
face (GUI)-based video output display, a con- 
trol device for generating cursor control on 

said video output display and for operating 
said plurality of target devices, said control 
device comprising: 25 

host system configuration means coupled 
to said CPU for generating a plurality of op- 
erating modes for each of said plurality of 
target devices on said GUI-based video output 
display, said host system configuration means 30 
generating control data for each of said plural- 
ity of operating modes capable of controlling 
said plurality of target devices by retrieving 
said control data from said memory; 

control means coupled to said host system 35 
configuration means for selecting one of said 
plurality of operating modes for one of said 
plurality of target devices through said GUI- 
based video output display, said control means 
causing said host system configuration means 40 
to transmit said control data corresponding to 
one of said plurality of operating modes for 
one of said plurality of target devices; 

receiver means coupled to said control 
means for receiving said control data from said 45 
host system configuration means; 

modulator means coupled to said receiver 
means for modulating said control data with 
infrared signal; 

transmitter means coupled to said modu- so 
lating means for transmitting said infrared sig- 
nal modulated with said control data to said 
one of said plurality of target devices; 

optical interface means coupled to each of 
said plurality of target devices for receiving 55 
said infrared signal such that said control data 
operates said one of plurality of target devices 
when received by said target devices. 
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